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1 Introduction 



Given a matrix B G C™^", the Moore- Penrose generalized inverse of B is the unique matrix 
C e C"^"* which satisfies the system 

BXB = 5, XBX = X, {BXy = BX, (XS)* = XB. 

Thus, BC is the orthogonal projection onto the column space R{B) of B and CB is the 
orthogonal projection onto the column space R{B*). In many applications, it appears to be 
necessary to change the scalar products in the spaces of input and output vectors. More 
precisely, given B G C"*><" and Ai e C"^", A2 G C"^^"* which are positive definite, the 
system to be solved is 

BXB = B, XBX = X, {A2BXy = A2BX, {A^XB)* = A^XB. (*) 

Again, there exists a unique solution C" G C"^™, BC (resp. C'B) is the orthogonal 
projection onto R{B) (resp. R{B*)) with respect to the scalar product on C"* (resp. C") 
defined by A2 (resp. Ai). In some applications a singular version of the problem needs to 
be solved. Thus, Ai and A2 are supposed to be positive semidefinite. In this case, solutions 
of (*) always exist but they are infinitely many. Among them, there exists a unique solution 
of minimal Euclidean norm. In other applications in which very large numbers of variables 
are involved, it can be desirable to solve system (*) for bounded hnear operators between 
Hilbert spaces. It should be noticed that, in such cases, the first two conditions of (*) force 
B to have a closed range and any solution will have, also, a closed range. In this case, the 
existence of a solution is not guaranteed. The goal of this paper is the complete solution 
of the following problems. Let 7i and /C be Hilbert spaces, B : 7i ^ JC a bounded linear 
operator with closed range and Ai : — > : /C — > /C positive semidefinite bounded 

linear operators. Consider the seminorm || • ||^^, (resp. || • H^a) on Ti (resp. on /C) defined 
by II^IIai = {AiXjXy^"^, ior x eH { respectively \\x\\a2 — {A2X,xy^'^, for x G /C). 

Problem I 

Find necessary and sufficient conditions for the existence of solutions of system (*). 
Problem II 

Find all solutions of system (*), in case there exists one. 
Problem III 

Find necessary and sufficient conditions for the existence of uq G Ti such that \\y — 
Buo\\a2 ^ \\y — Bx\\a2 for every x G 7i and ||mo|Ui < ll'^^IUi, for every u G 7i such that 
\\y — Bu\\a2 < \\y — Bx\\a2, ^or every x &Ti.. 

Problem IV 

In case there exists an uq as above, find all of them and, among them, find one of minimal 
Euclidean norm. 

It should be mentioned that, if the weights Ai and A2 are supposed to be invertible, then 
existence and uniqueness of solutions of system (*) follow immediately from the analogous 
results on Moore-Penrose generalized inverses, changing the inner products of Ti. and /C (or 
C" and in the finite dimensional case). In this case. Problems I to IV have a unique 



2 



solution. The reader is referred to the complete survey by Nashed and Votruba , section 
4.5, and to the more modern treatment by Nashed [23J, with emphasis in Banach and Hilbert 
space operators. 

Before the description of the main results of the paper let us give a look to the history 
of the subject. 

Historical notes. 

The first appearance of weighted generalized inverses of matrices is due to Greville ^7] 
who used them in problems involving least squares fitting of curves and surfaces. As it 
happens with every natural useful notion, many results on generalized inverses have been 
discovered once and again by mathematicians, statisticians and engineers. Thus, Chipman [Hj 
reintroduced the notion for linear regression problems. Also Goldman and Zelen jTH] , Watson 
(Mj . Zyskind jHSl and Rao and Mitra j2Zj, |2H|; 12^]; found applications to statistics. Milne 
PU] introduced a version of "oblique pseudoinverse" for matrices and Ward, BouUion and 
Lewis [31J proved that Milne's oblique pseudoinverses can be thought as weighted generalized 
inverses with invertible weights. In a later paper jHSI they extended some results to singular 
weights. In fact, in the papers mentioned above the weights are represented by positive 
definite matrices and Ward, Bouillon and Lewis relaxed the hypothesis on the weights. 
Ward 33 found a limit formula for weighted generalized inverses. Some related results with 
a different approach have been obtained by Rao and Mitra j^ZI, [21]; [21] and Morley [22]- 

In 1980, Elden [Hj published a complete treatment of the existence of optimal weighted 
generalized inverses for singular weights in finite dimensional spaces. The present paper can 
be seen as an extension of Elden's approach to infinite dimensional Hilbert spaces. For recent 
results on this subject the reader is referred to the papers by Sun and Wei [30J, Stanimirovic 
and Stankovic (23 and Djordjevic, Stanimirovic and Wei JT]. For applications to parallel 
computing, image processing and many algorithmical results which use weighted generalized 
inverses with singular weights, the reader is referred to the papers by Censor, Gordon and 
and Gordon [1], |H] and Censor and Elfving, [2], |S]- The papers by Nashed and Votruba [21] 
and Nashed and the books by Rao and Mitra [21] and Ben-Israel and Greville [T] are 
excellent references, which contain many results on weighted generalized inverses. 

The contents of the paper are the following. Section 2 contains all results on the notion 
of compatibility of a closed subspace of a Hilbert space H and a positive bounded operator 
A acting on Ti. Section 3 is devoted to solve Problems I and II in terms of compatibility. In 
Section 4 we solve Problems HI and IV and show an application of our techniques by proving 
a result by Morley [22 on an infinite dimension regression model with singular covariance. 

2 Preliminaries 

Throughout, H, /C, Q denote Hilbert spaces, L(7i, /C) is the space of bounded linear operators 
from TC to /C, L{TC) is the algebra L(H, TC) and Lili,)^ denotes the cone of positive semidefi- 
nite operators. For any C G L{H, /C) the image or range (resp. the nullspace) of C is denoted 
by R{C) (resp. N{C)). CRiH, JC) is the subset of L(TC, JC) of all operators with closed range. 
For any B G CR(H, /C) the Moore-Penrose inverse of B is the operator B^ G CR{]C, Ti) such 
that B'^Bx = X for every x G N{B)-^ and B'^y = for every y G R{B)-^. B^ is characterized 
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by the properties BB^B = B, B^BB^ = B\ (BB^)* = BB\ (B^B)* = B^B. If H is 
decomposed as a direct sum of closed subspaces H = A4 Q) Af, the projection onto M. with 
nullspace M is denoted by PM\\Af- In particular, given a closed subspace A4 of H, Pm denotes 
the projection Pj^\\j^^- Denote Q = {Q & LiH) : = Q}. The Moore-Penrose inverse 
B^ of B & CR{TC,]C) is determined by the properties BB^ = Pr(b) and B'^ B = -P/y^^^j- or, 
equivalently, by: 

(i) WBB'^y — y\\ < \\Bx — y\\ for every x G 7i; 

(ii) ll-B^l/ll < ll-^ll for every z ^Ti such that \\Bz — y\\ < \\Bx — y\\ for every x ^Ti. 

An operator A G L{T-C)^ and a closed subspace S oi Ti form a compatible pair {A,S) 
if there exists a projection Q G such that R{Q) = S and AQ = Q*A. The last 

condition means that Q is A-Hermitian in the sense that < Qx, x' >a= < 2;, Qx' >a, for 
every x^x' G ?i, where < x^x' > p = < Ax,x' > defines a semi inner product on 7i, which 
is an inner product only if A^(^) = {0}. There is also a seminorm defined by A, namely 
\\x\\a =< Ax, X >^/^ for X E H. 

Denote P{A,S) = {Q G Q : i?(Q) = S and AQ = Q*A}, i.e., P{A,S) is the set of 
A-Hermitian projections with fixed range S. The set P{A, S) can be empty (if {A, S) is 
not compatible), or have one element (for example, if A is positive definite) or have infinite 
elements. It is easy to see that if S is finite dimensional (and, a fortiori, if Ti is finite 
dimensional), then every pair A,S is compatible [Hj. The compatibility of a given pair 
{A, S) has been characterized in terms of angles between subspaces and decompositions of 
the ranges of A and A^^'^. It has also been proven that the compatibility of (A, S) is equivalent 
to the existence of a solution of the equation PAPX = PA{I — P), where P = P5. (See [H], 
in] for details). This kind of equations can be studied applying Douglas theorem: 

Theorem 2.1. Given Hilhert spaces H, IC, Q and operators A G L{7i,Q), B G L{IC,Q) then 
the following conditions are equivalent: 

i) the equation AX = B has a solution in L(/C,7i); 

iz) R{B) C R{A); 

Hi) there exists A > such that BB* < XAA* . In this case, there exists a unique 
D G L{IC,n) such that AD = B and R{D) C R{A*); moreover, = inf{A > : BB* < 

XAA*}. We shall say that D is the reduced solution of AX = B. 

The reader is referred to [13] and [12] for the proof of Douglas theorem and related results. 



Suppose that {A, S) is compatible and consider the reduced solution D of the equation 
PAPX = PA{I — P). Define Pa,s = P + D, or, in terms of the matrix representation 

induced by P, Pa,s ~ ' ^^^^^ ^ identified with the identity in L{S), D with the 

operator d = D\g± G L{S-^,S). The next theorem characterizes the set P{A,S): 

Theorem 2.2. Let A G L(7i)^ and S a closed subspace ofTi such that {A,S) is compatible. 
Then Pa,s ^ P{A,S) and it is the projection onto S with nullspace A~^{S^) {N{A) fl S). 
The set P{A,S) is an affine manifold and it can be parametrized as 

P{A, S) = Pa,s + L{S^, N{A) n S), 

where L{S^ , N{A) nS) is viewed as a subspace of LiTi). 
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Given T G LiTi, /C), a closed subspace S of Ti, and an element y eH, an abstract spline 
or a {T,S)-spline interpolant to ?/ is any element of the set 

spl{T,S,y) = {x ey + S : \\Tx\\ < \\T{y + s)\\ for all s G S}. 

It holds that spl(T, S, y) = {y + S) H A{S)-^ where A = T*T. The abstract theory of splines 
is due to Atteia [?]. The reader is referred to ^21 and ^H] for some relationships between 
abstract splines and generalized inverses. 

The following theorem relates the existence of splines to compatibility: 

Theorem 2.3. Let T G L(7i,/C) and S a closed subspace ofTt. If A = T*T, then: 

a) spl{T, S, y) is not empty for every y eH if and only if the pair {A, S) is compatible. 

b) If {A,S) is compatible and y ETi.\S then spl{T,S,y) = {{I — Q)y : Q G P{A,S)}. 
Furthermore, (/ — PA,s)y is the unique vector in spl{T,S,y) with minimal norm. 

See [TU] for the proofs of these assertions. 

3 Weighted generalized inverses 

Theorem 3.1. Given B G CR{n,IC), Ai G L{ny and A2 G L(/C)+ there exists C G 
L(/C, Ti.) such that 

BOB = B, CBC = C, AiCB = B*C*Ai, A2BC = C*B*A2 (1) 
if and only if {Ai, N{B)) and {A2, R^B)) are compatible pairs. 

Proof. Suppose that C G L{IC,H) satisfies ((H). Notice that C has closed range: in fact 
the projection P = BC on /C has the same range as B and the projection Q = CB has 
the same range as C; of course, Q is a bounded linear projection and, therefore, its range 
is closed. It follows easily that Q (resp. P) and B (resp. C) have the same nullspace. 
Observe also that the third and fourth conditions of (P) say that Q is Ai— Hermitian and 
P is v42-Hermitian. Then / - Q is also Ai-Hermitian and R{I - Q) = N{Q) = N{B), 
which proves that I -Q e P{Ai,N{B)). Analogously, P G P{A2,R{B)). This shows that 
{Ai,N{B)) and {A2,R{B)) are compatible pairs. 

Conversely, suppose there exist Q' G P{Ai,N{B)) and P G P{A2,R{B)). Then Q = 
I — Q' is y4i-Hermitian and N{Q) = R{Q') = N{B). Consider the decomposition /C = 
R{B) © N{P) and define C : IC ^ H hj C{Bx + z) = Qx, for x e H, z e N{P). C is 
well defined because N{B) = N{Q). It is also easy to check that C is a linear operator, 
with R{C) = R{Q) and N{C) = N{P); C is also bounded, because 5|^(q) : R{Q) 
R{B) is an isomorphism by the closed graph theorem and C\r(^b) = (-B|_r(q))~^. This also 
implies BCB = B. It remains to prove the other conditions of (^. On one side, it holds 
CBC{Bx + z) = CBx = C{Bx + z) for every x e H and z G N{P). On the other side, 
CB = Q is v4i-Hermitian and BC = P is yl2-Hermitian. □ 

From now on, GI{B, Ai, A2) denotes the set of all bounded linear solutions of (*): 
GI{B, Ai, A2) = {C e CR{IC, H) : BCB = B, CBC = C, A^CB = B*C*Ai, A2BC = C*^*^}. 
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The proof of the theorem above and the characterization of the set of generahzed Hermitian 
projections of a given range described in section 2, provide the following parametrization of 
GI{B,Ai,A2y. 

Proposition 3.2. The set GI{B, Ai, A2) is parametrized by the vector space 
L{N{Bf,N{Ai) n N{B)) x L{R{Bf,N{A2) n R{B)). 

Proof. The proof of the theorem above shows that the construction of a bounded linear 
solution of (*), if there exists any, is based in the choice of two projections, namely, I — Q & 
P{Ai, N{B)) and P G P{A2, R{B)). It is not difficult to prove that different choices provide 
different solutions of (*). On the other hand, following the notations and results of section 2, 
P{Ai, N{B)) is in bijection with L{N{B)^ , N{Ai) n N{B)) and P{A2, is in bijection 

with L{R{B) , N {A2) r\ R{B)) . With these comments, the result follows straightforward. □ 

The parametrization just obtained is quite indirect. The following results of this section 
are devoted to find more explicit parametrizations of GI{B, Ai, A2). 

The first goal is to generalize Douglas theorem in order to get convenient solutions of 
Douglas-type equations. 

Theorem 3.3. Let Ti, K, and Q he Hilbert spaces. Given A G L{T-l, Q) and B G L{K,, Q) such 
that R{B) C R{A), for every closed suhspace M-ofTi such that Ti = N{A) (BM. there exists 
a unique solution C G L(/C,7i) of the operator equation AX = B such that R{C) C Ai. The 
nullspace of C coincides with that of B. 

Proof. Consider the reduced solution C' G L(/C,7i) of AX = B and define C = Pm\\n{A)C' ■ 
Obviously, R{G) C M. Observe that AC = APm\\n{a)C' = AC' = B because A{I - 
Pm\\n{A)) = APi\f(^A)\\M = 0. Therefore, AC = B, which proves the existence statement. 

Suppose that D G L{}C,n) satisfies AD = B and R{D) C M. Then, A{D - C) = so 
that R{D-C) C N{A). But R{D-C) C M and, therefore, R{D-C) C N{A)r]M = {0}. 
This shows that D = C. 

The last assertion follows easily: N{C) C N{B) because AG = B; conversely, if Bx = 
then Gx G N{A) f] R{G) C N{A) f] M = {0}, which shows that N{B) C N{C). □ 

Given B G GR{H,IC) let us denote B{1} = {G e L(/C,H) : BGB = B} and B{1,2} = 
{G G L{}C,n) : BGB = B and GBG = C}. Following the notations of Ben Israel and 
Greville PP, we call any C G B{1} an {l}-inverse of B and any C G 5(1,2} an {1,2}- 
inverse of B. 

Corollary 3.4. Consider B G Ci?(7i,/C) and projections Q G L{7{), P G L{1C) such that 
N{Q) = N{B) and R{P) = R{B). Then there exists a unique solution G G L{}C,T-C) of 

BX = P, R{X) = R{Q). (2) 

It holds C G B{1,2} and N{C) = N{P). 
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Proof. Observe the decompositions H = N{Q) © R{Q) = N{B) © R{Q) and the inclusion 
R{P) C R[B). By Theorem 3.3, there exists a unique C G L(1-C,IC) such that BC = P and 
R{C) C R{Q), and C satisfies also N{C) = N{P). It remains to prove that C G B{1,2} 
and i?(g) C R{C). 

Since /?(P) = R{B) it follows that PB = B so that = PB = B; also C(/ - P) = 

because A^(C) = A^(P) = R{I - P); therefore, CBC = CP = C and this proves that 
C G P{1,2}. In order to prove the inclusion R{Q) C R{C), observe first that N{B) C 
N{CB) C N{CBC) = N{B), so that N{CB) = N{B) = N{Q). Then, CB and Q are 
bounded linear projections with the same nullspace and R{CB) C P(C) C R{Q) and, 
therefore, CB = Q and, a fortiori, P(C) = R{Q). □ 

Observe first that any solution C of 

PX = P, N{X) = N{P) (2') 

satisfies BCB = B because BC = P and PB = B; similarly, C{I — P) = because 
N{C) = N{P) and then, CBC = CP = C. Thus C G P{1,2}. By the generahzation of 
Douglas theorem, there exists a unique solution C G L(/C,7i) of 

BX = P, N{X) = N{P), R{X) C R{Q). (3) 

By the first remark, it holds CBC = C, so that (CP)^ = CP. Moreover, A^(C) = 
A^(PC) = N{P) and P(CP) C R{C) C P(g). Thus, CP is a projection with Ar(CP) = 
N{B) = N{Q) and P(P) C P(Q). By the first remark, it holds CBC = C, so that 
(CP)2 = CP. Moreover, A^(C) = A^(PC) = N{P) and P(CP) C P(C) C P(Q). Thus, CP 
is a projection with N{CB) = N{B) = N{Q) and P(P) C P(Q). By elementary theory 
of projections, it holds CP = Q and, a fortiori, P((5) = R{CB) C P(C) C R{Q), so that 
P(C) = P(Q) and this proves that C is a solution of ((21) . Uniqueness of solutions of Q 
follows from that of (jHI). 

Notation: In what follows, Ppg denotes the unique solution of It follows from the 

proof that BpQ is the unique operator in L(/C, H) such that 

BB^Q = P and B^p^B = Q. (4) 

Of course, Ppg has closed range, namely R{Q). 

As a corollary, we get another parametrization of GI{B^ Ai, A2): 

Corollary 3.5. Suppose that (Ai, A^(P)) and {A2, R{B)) are compatible pairs. Then 
CI{B, A,, A2) = {B^pj_Q : P G P{A2, P(P)), Q G P(Ai, iV(P))}. 

Proo/. Let Q G P(Ai,A^(P)), P G P{A2,R{B)). Then Pp^j.g satisfies the equivalent of 

dH): BBI,j_q = P, B^pi_qB = I -Q. The fact that P (resp. / - Q) is A2 (resp. Ai)- 

Hermitian, together with the identities BBp j^qB = B and Bp j_qBBp j_q = Bp j_Q, prove 

that Pp,/_Q belongs to C/(P, Ai, A2). 

Conversely, if C G C/(P, Ai, A2) then C satisfies (*). Then P = BC e P{A2, P(P)) and 
if g = CP then I -Q e P{Ai, N{B)). Thus, C is the unique solution P].,7_q of 0. □ 
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The next result gives a better way of constructing Bpg in terms oi B{1}. As a corollary 
we shall get a simpler parametrization of GI{B, Ai, A2). 

Proposition 3.6. Given B G CR{T-C, JC) and projections Q G L{T-C) and P G L{1C) such that 
N{Q) = N{B) and R{P) = R{B) it holds B^p^ = QB^^^P for any B^^^ G B{1}. 

Proof. Take any B^^^ & B{1} and let M = R{B^^^B). Then H = M ® N{B) because 
N{B) = A^(S(i)5), and B^^'^B is a projection onto M. Define C = QB^^^P. Straightforward 
computations show that N{C) = N{P). Let us prove that R{C) = R{Q): observe that 
R{Q) = QM; then R{C) = Q{R{B'P)) = Q{R{B'B)) = QM, because P and B have the 
same range. Finally, the identity BQ = B, due to the fact that N{Q) = N{B), implies 
BC = BQB^^^P = BB^^^P = P, because BB^^^ is a projection onto R{B) = R{P). Thus, 
C satisfies and, by Proposition IH.4I it follows that BpQ = QB^^^P, as claimed. □ 

The last result of this section gives a more explicit parametrization of GI{B, Ai, A2). 
The fact that we use the Moore-Penrose inverse of B instead of an arbitrary choice of a 
{l}-inverse of B is not relevant. 

Theorem 3.7. If {Ai, N{B)) and {A2, R{B)) are compatible pairs then 

GliB, A,, A2) = {(/ - Q)B^P : Q G P(Ai, N{B)),P G P{A2, R{B))} 
where B'^ is the Moore-Penrose inverse of B. 

Proof. It follows by combining the last proposition with Corollarv 13.51 □ 

Remark 3.8. Milne [20^ defined what he called the oblique pseudoinverse of an operator 
acting between finite dimensional Hilbert spaces. Let B G LiV, W) and let /C C V, £ C VV 
be two subspaces such that V = 1C®N{B) and >V = R{B)®C. The oblique pseudoinverse of 
B with respect to the subspaces fC and C is defined as the unique 

B]cc^ L(W, V) satisfying 

Bj^ ^Bv = V for every f G /C and Bj^^vu = for every w & C. Milne's definition and 
results have trivial extensions to closed range operators between infinite dimensional Hilbert 
spaces. If (5 G -^^(V) is the projection onto /C with nullspace N{B) and P G L{W) is the 
projection onto R{B) with nullspace £, then it can easily be shown that B]^ ^ satisfies ^ 

so that B](- £ = -BpQ. It should be remarked that Milne proved that B]^- ^ = QB^^^P for any 

-B*-^^ G B{1}. An algebraic treatment of the properties of BpQ can be found in the survey 
by Nashed and Votruba fI^ . 

4 Least squares formulation 

The great impact that Moore-Penrose inverses have in science is due to the fact that they 
solve a least squares problems, namely, B^c is the unique vector in Ti. with minimal norm 
among those which minimize \\Bx — c\\. We generalize this result for the weighted case, i.e., 
if we consider weights Ai and A2 on H and /C, respectively. 
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Definition 4.1. Given B G L{H,}C), Ai e L(Hy , A2 G L(/C)+ and y e IC, an element 
u eH. is said to he an A2-least squares solution (hereafter, A2 — LSS ) of the equation 

Bx = y (5) 

if \\Bu — y\\A2 ^ \\Bx — y\\A2 for every x & H. 

An element ETi is said to he an AiA2-least squares solution {hereafter A1A2 — LSS) 
of ^ if uq is an A2-LSS of ^ and \\uo\\ai < II^^IUi for every u which is an A2-LSS of 

Lemma 4.2. Given B G C/2(7i,/C) and A G L(/C)+ there exists an A— LSS u E IH. of the 

equation Bx = y for every y E K, if and only if the pair {A, R{B)) is compatihle. 

Proof. Observe that G ?^ is an A— LSS of Bx = y ii and only if m G spl^A^^"^ , R{B),y). 
Then Bx = y admits an A— LSS for every y E IC if and only if spl{A^^'^ , R{B),y) is not 
empty, for every y E IC, which, by item a) of Theorem \'2M\ is equivalent to the compability 
of ( A '5). □ 

Remark 4.3. Given B E C-R(7i,/C), T E L{K,,Q) and y G /C, it follows from the pre- 
liminaries that Uq E Ti is an y4-LSS of Bx = y (where A = T*T E L{1C)^) if and only if 
y — Buq E spl{T, R{B),y). Therefore, by the characterization of splines in the preliminaries 
section, given y E JC there exists an A-LSS Uq of Bx = y if and only if y G Buq + R{AB) . 
The next result determines all A-LSS of © if {A, R{B)) is compatible. 

Proposition 4.4. Given B E CR{H,}C), A E L{K,)^ such that {A, R{B)) is compatihle, 
and y E )C\ R{B), then u eH is an A-LSS of (0) if and only if there exists P E P{A^ R{B)) 
such that Bu = Py. 

Proof If y E }C\ R{B) then by Theorem it holds spl{A^/^ , R{B),y) = {(/ - P)y : 
P E P{A, R{B))} so, by the last remark, u is an ^d-LSS of (0) if and only if y — Bu E 
spl{A^^'^, R{B),y) and the result follows. □ 

Observe that if y G R{B) then every element u E B^^{{y}) (i.e., every solution of 
Bx = y) is trivially an A-LSS solution of (0). In fact, in this case, w G H is an A-LSS of (0) 
if and only if y — Bu E N{A). 

Remark 4.5. If N{A) n R{B) = {0} then m G H is an A-LSS of ® if and only if B*A{Bx - 
y) = 0. In fact, P{A, R{B)) consists of a single element P = Pa,r{b) whose nuUspace is 
A~^{R{B)^) = R{AB)'^ . Straightforward computations prove the statement. 



If y E )C \ R{B) then, by Proposition 14.41 the set of all A-LSS of (0) is given by 
[j{B-^{Py} : P E P{A,R{B))} and, for a fixed P, B-^{Py} = Xq + N{B), where Xq 
is the unique element of B~^{Py} fl N{B) . Notice that xq = PAr(B)xXo = B'^Bxq = B^Py. 

Let us study a minimizing problem in Ti. 

Lemma 4.6. Gonsider B E L{7i,}C) and A E L(7Y)+ such that {A,N{B)) is compatihle. 
Then, for every non zero xq E N{B)-^ and u E xq + N{B), it holds \\u\\a < II^^IU for every 
X E xq + N{B) if and only if there exists Q E P{A, N{B)) such that u = {I — Q)xo. 
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Proof. Decompose u = Xq + Pn{b)U- Then \\u\\a < ll^-iU for every x G Xq + N{B) if and 
only if IImIIa < ||a^o + Pn(b)x\\a for every x E Ti. or equivalently, u is an A-LSS of the 
equation Pn(^b)X = —xq. Applying the last proposition to the operator Pn{b) and the vector 
xo e H \ N{B) = 7i \ R{Pn{b)) this is equivalent to the existence of Q € P{A, N{B)) such 
that Pn(^b)U = —Qxq. Adding xo to the last equality, we get u = {I — Q)xq as claimed. □ 

Remark 4.7. If Xq = then \\u\\a < II^^IU for every x G N{B) if and only if \\u\\a = 0, 
which means that u G N{A) fl N{B). 

We are now in position of finding all 74iA2-LSS of Bx = y. 

Proposition 4.8. Let B G CRiH, /C), Ai G L(ny and A2 G L(/C)+ be such that {Ai,N{B)) 
and {A2, R{B)) are compatible pairs. Consider y G /C \ R{B) and u E TiX N{B). Then u 
is an A1A2-LSS of the equation Bx = y if and only if there exist Q G P{Ai, N{B)) and 
P G P{A2, RiB)) such that u = {I - Q)B^Py. 

Proof. Suppose that u is an y4iA2-LSS of Bx = y. In particular, u is an j42-LSS of Bx = y 
and, by Proposition 14.41 there exists P G P{A2, R{B)) such that Bu = Py. Then xq = 
Pn{b)^'^ = B'^Bu = B^Py is non zero because Bu 7^ 0. By the lemma above, replacing A 
by Ai, there exists Q G N{B)) such that u = (I - Q)xq = (/ - Q)B^Py. Conversely, 

suppose u= {I - Q)B^Py for some Q G P{Ai,N{B)) and P G P{A2,R{B)). Then Bu = 
B{I — Q)B'^Py = BB'^Py = Py (the second equality holds because BQ = 0; the third one 
follows from the facts that BB^ = Pr{b) and P projects onto R{B)). Then, by Proposition 
01 M is an A2-LSS of Bx = y. On the other hand u = {I-Q)B^Py = B^Py = QBPy is the 
decomposition of u according to Ti. = N{B)^ © ^(-S) and from the lemma above it follows 
that ||m|U < ll-^IUi for every z G B'^Py + N{B), which is the set of 742-LSS of Bx = y, by 
the comments following Proposition 14.41 This finishes the proof. □ 

Theorem 4.9. Given Ai,A2,B and y as before consider the problem 

min{||y — Bu\\ : u is an A2 — LSS of Bx = y} (6) 

Then: 

i) uo is a solution of ^ if and only if Buq = -P42,r(b)2// 

a) Uq is a solution of ^ and an A1A2-LSS of Bx = y if and only if Uq = (/ — 
Q)B^PA,,RiB)y for some Q G P{A,,N{B)); 

Hi) the unique minimal norm element of the set {{I — Q)B'^ PA2,R{B)y '■ Q ^ -P(^i) ^i^))} 
is {I - Pa^,n(b))B^ PA2MB)y ■ 

Proof. To prove i) observe that by Proposition 14.41 un is an yl2-LSS of Bx = y if and only if 
there exists P G P{A2, R{B)) such that Bu = Py; then we look for 

mm{\\{I-P)y\\:PePiA2,R{B))}. 

But, by theorem 12. 31 in the Preliminaries, this minimum is attained in {I — PA2,R{B))y so that 
Buo = PA2,R(B))y- 

In a similar way, by proposition 14.81 and i), Uq is an y4iyl2-LSS of Bx = y and a solution 
of (jni) if and only if there exists Q G P{Ai, N{B)) such that uq = {I ~ Q)B'^ PA2,R{B)y and 
ii) follows. 
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To prove iii) observe that the minimum of the set 

{\\{I-Q)B^Pam\\ ■■ Q e P{A,,N{B))} 
is attained, by Theorem 12 .31 in (/ — Pai,n{b))B'^ Pa^zMb)- ^ 

In 122] Morley solved the following problem: Given a (densely defined unbounded) linear 
operator B : H ^ K., with R{B*) closed, c e R{B*) and V e L(/C) such that V'^ positive 
semidefinite, find 

min{< V^y, y >: B*y = c}. (7) 

If (7 is a solution of this minimizing problem, g is called a best linear unbiased estimator 
(BLUE). 

This result is equivalent to solving the following least squares problem with linear equality 
constraints: given C G L(H, /C), a closed subspace S of H, Xq & H and y G /C, find 

inf{||Cx — y\\ : X E Xq + S}. 

In fact, 

min{< V^y,y >: B*y = c} = min{||?/||y2 : B*y = c}. 

Observe that B*y = c if and only if there exists w G N{B*) such that y = B*'^c + w; so 
that dZj) is equivalent to the problem of finding 

mm{\\ B*^c + w\\v2 : w G N{B*)}. 

The next proposition is a proof of Morley's result in terms of compatible pairs, for the 
case of bounded operators. 

Proposition 4.10. Consider C G CR(Ti.,IC), S a closed subspace ofH, xq eH and y G /C 

such that the pair {C*C, S) is compatible. Then \\Cu — y\\ < \\Cx — y\\ for every x E xq + S 
if and only if there exists Q G P{C*C, S) such that u = {I — Q){xq — C^y)- 

Proof. Observe that \\Cx — y|p = \\Cx — Pr(c)2/||^ + ||-PR(C7)iy|P so that 

inf \\Cx - = \\Pr[c)M? + inf \\Cx - Pij(c)2/f . 

If = C^Pr^oV = C^y then \\Cx - F«(c)2/|| = \\C{x - C^y)\\ = \\x - C^yWcc = 
\\x - Uo\\c*C 
so that 



inf ||Cx - 2/f = ||-Pij{c)i2/f + - xo\\l*c = \\PR(c)^yf + i^f , 



\X\ 



|2 

\c*c- 



By Lemma 14.61 it follows that H-uUc'C ^ ||3^||c*c for every x E Xq — Uq + S if and only if 
there exists Q G P{C*C,S) such that u = {I - Q){xo - uq) = (/ - Q)(xo - C^y). □ 
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